Abstracted display building method and system

ABSTRACT

A machine can be accessed and controlled with the help of an interface device. The customizable interface device contains device elements that define features relating to the external representation and internal functionality of the interface device, as linked to one or more machines. An operator can use a configuration station to implement single or reoccurring queries that interact with the interface device and corresponding machines. In particular, the queries target the configuration of device elements in the interface device. The process can include temporarily unloading unused features from active memory and mirroring property changes initialized by a source. An emulator can assist in the configuration process by providing a preliminary software representation of the interface device hardware. A user can develop, test, and reconfigure functions on the emulator before loading the finalized platform to the interface device.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.11/537,479, filed Sep. 29, 2006, entitled, “ABSTRACTED DISPLAY BUILDINGMETHOD AND SYSTEM”, which is a continuation-in-part of U.S. patentapplication Ser. No. 10/980,588, filed Nov. 3, 2004, entitled, “HMIRECONFIGURATION METHOD AND SYSTEM”, U.S. patent application Ser. No.11/050,923, filed Feb. 4, 2005, entitled, “CONFIGURABLE INTERFACECONFIGURATION METHOD AND SYSTEM USING A REMOTE INTERFACE”, U.S. patentapplication Ser. No. 11/147,586, filed Jun. 7, 2005, entitled, “REALTIME PARALLEL INTERFACE CONFIGURATION AND DEVICE REPRESENTATION METHODAND SYSTEM”, U.S. patent application Ser. No. 11/147,604, filed Jun. 7,2005, entitled, “ABSTRACTED DISPLAY BUILDING METHOD AND SYSTEM”, U.S.patent application Ser. No. 11/147,590, filed Jun. 7, 2005, entitled,“ENHANCED SPEED INTERFACE METHOD AND SYSTEM”, U.S. patent applicationSer. No. 11/147,603, filed Jun. 7, 2005, entitled, “DYNAMICREPRESENTATION OF COMPONENT CONFIGURATION METHOD AND SYSTEM”, U.S.patent application Ser. No. 11/147,582, filed Jun. 7, 2005, entitled,“UNIVERSAL WEB-BASED REPROGRAMMING METHOD AND SYSTEM”, U.S. patentapplication Ser. No. 11/147,591, filed Jun. 7, 2005, entitled,“EVENT-DRIVEN COMPONENT MIRRORING METHOD AND SYSTEM”, U.S. patentapplication Ser. No. 11/147,607, filed Jun. 7, 2005, entitled, “METHODAND SYSTEM FOR INTERFACE CONFIGURATION VIA DEVICE-SIDE SCRIPTING”, U.S.patent application Ser. No. 11/147,588, filed Jun. 7, 2005, entitled,“EMULATOR FOR GENERAL PURPOSE VIEWER CONFIGURABLE INTERFACE”, and U.S.patent application Ser. No. 11/147,589, filed Jun. 7, 2005, entitled,“RELEGENDABLE INTERFACE DEVICE DESIGN-TIME ENVIRONMENT SYSTEM ANDMETHOD”. The entireties of the aforementioned applications areincorporated herein by reference.

TECHNICAL FIELD

The subject invention relates generally to interface devices, and moreparticularly to the configuration of such interface devices toeffectively manage industrial control systems.

BACKGROUND

Factories that utilize machines to produce products depend on reliableindustrial control systems. Machines can be responsible for building,refining, and testing various objects. The machines themselves may alsorequire regular or sporadic monitoring, maintenance, adjustment,management, testing, and repair. Skilled workers may be allowed to turnoff a machine to complete a task or be required to work on the machineas it is running However, such equipment can expose individuals todangerous conditions. Those who work directly with machines usually haveto wear protective clothing to minimize impact of potential injuriesfrom accidents. In addition, workers need to adapt to the operatingenvironment of the machines. For example, if specific products ormachines operate in a low temperature environment, the workers on theproduction floor have no choice but to endure the cold. This can beuncomfortable or inconvenient for the workers.

Likewise, people working with such equipment can expose manufacturedproducts to contamination. Hair, dirt, oil, and germs from humans maydamage certain highly sensitive products. Protective clothing thereforemust protect not only the person from injuries, but also the machinefrom contamination through human contact. Unfortunately, suchprecautions are not always sufficient to guard against these risks. Forexample, time and resources are often wasted to discard unrecoverableproducts in order to maintain quality control standards.

Interface devices provide a safe intermediate link between operators andmachines. The employment of interface devices allows people to monitorand control equipment without working in immediate physical proximity ofthe machines. While interface devices are useful because operators canmaintain a distance from the machines for safety and quality concerns,interface devices also enable operators to work on machines withoutbeing in their direct view (e.g., machines that are enclosed in a caseor that reside in another room). Operators depend on the accuracy,convenience, and ease of use of interface devices. It is thereforebeneficial that interface devices be as versatile, efficient, andreliable as possible.

SUMMARY

The following presents a simplified summary of the subject matter inorder to provide a basic understanding of some aspects of subject matterembodiments. This summary is not an extensive overview of the subjectmatter. It is not intended to identify key/critical elements of theembodiments or to delineate the scope of the subject matter. Its solepurpose is to present some concepts of the subject matter in asimplified form as a prelude to the more detailed description that ispresented later.

An industrial automation setting includes an operator that interactswith a machine via a customizable interface device and correspondingconfiguration station. The customizable interface device can beconfigured in a unique manner that is more efficient and personalizedover conventional interface devices. Settings may be implemented thatdictate when and how configuration takes place, supporting seamlessoperation during configuration. Within an interface device, deviceelements (also referred to as control objects) are software componentsthat define features of the device, such as properties, methods,connections, and communications interfaces. Together, the deviceelements represent most if not all aspects of the interface device andcan be configured or reconfigured through remote or direct access.

A configuration station is a tool used by an operator to access theinterface device, as well as send commands to the machine it is linkedto. A user can interact with the interface device via a configurationstation by setting up queries for single or recurring processes. Thedevice elements can be reconfigured in the configuration station (byfirst uploading the device elements from the interface device to theconfiguration station) or directly in the interface device (throughlocal or remote access). When device elements are reconfigured withoutfirst being uploaded to the configuration station, the interface devicecan switch between a development environment (to support a configurationmode) and an operational environment (to support an execution mode). Attimes, it may be preferable for the interface device not to switchbetween environments, and in those situations the interface device maybe configured to accommodate changes while remaining in an operationalenvironment.

The device elements can reside in their respective interface devices. Inanother configuration, some device elements can be located in theinterface device and other device elements located at a remote location.Different interface devices can efficiently share device elements thatare housed in a central remote location. One feature of interfacedevices is the ability to alter their appearances to suit a user'spreferences. Not only can visual templates be customizable, they can besaved and sent to other interface devices. Furthermore, a singleinterface device can switch among various visual templates to easilyserve the specific needs of multiple users.

Additional aspects of interface devices provide for conserving memoryand optimizing overall efficiency. One approach supports temporarilyunloading unused features from active memory until they are neededagain. Another approach targets device element mirroring for propertychanges. Rather than waste network resources to transmit redundantinformation, an identical or related device element can mirror a changeof another device element. To further conserve resources, users canenlist the help of an emulator to mimic the configuration of aninterface device without a dependence on such additional hardware meansof an extra interface device. Any development or customization can occuron the emulator as a convenient testing base to view and implement newfunctions through the customization of a user application file. The userapplication file can be perfected before it is downloaded to hardware(e.g., an interface device).

To the accomplishment of the foregoing and related ends, certainillustrative aspects of embodiments are described herein in connectionwith the following description and the annexed drawings. These aspectsare indicative, however, of but a few of the various ways in which theprinciples of the subject matter may be employed, and the subject matteris intended to include all such aspects and their equivalents. Otheradvantages and novel features of the subject matter may become apparentfrom the following detailed description when considered in conjunctionwith the drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an industrial control system.

FIG. 2 is a block diagram of a configuration station.

FIG. 3 is a block diagram of an interface device unloading system.

FIG. 4 is a block diagram of a device element mirroring system.

FIG. 5 is a block diagram of an emulation system.

FIG. 6 is a flow diagram of a method of facilitating industrial control.

FIG. 7 is another flow diagram of a method of facilitating industrialcontrol.

FIG. 8 is a flow diagram of a method of facilitating an unloadingmodule.

FIG. 9 is a flow diagram of a method of facilitating device elementmirroring.

FIG. 10 is another flow diagram of a method of facilitating deviceelement mirroring.

FIG. 11 is a flow diagram of a method of facilitating emulation.

FIG. 12 is a schematic block diagram illustrating a suitable operatingenvironment.

FIG. 13 is a schematic block diagram of a sample-computing environment.

DETAILED DESCRIPTION

The subject matter is now described with reference to the drawings,wherein like reference numerals are used to refer to like elementsthroughout. In the following description, for purposes of explanation,numerous specific details are set forth in order to provide a thoroughunderstanding of the subject matter. It may be evident, however, thatsubject matter embodiments may be practiced without these specificdetails. In other instances, well-known structures and devices areillustrated in block diagram form in order to facilitate describing theembodiments.

As used in this application, the terms “component” and “system” areintended to refer to a computer-related entity, either hardware, acombination of hardware and software, software, or software inexecution. For example, a component may be, but is not limited to being,a process running on a processor, a processor, an object, an executable,a thread of execution, a program, and/or a computer. By way ofillustration, both an application running on a server and the server canbe a computer component. One or more components may reside within aprocess and/or thread of execution and a component may be localized onone computer and/or distributed between two or more computers.

In FIG. 1, a block diagram of an industrial control system 100 thatfacilitates indirect control of a machine is depicted. The industrialcontrol system 100 comprises an interface device 120 and configurationstation 140 that together provide a working link between an operator 150and a machine 110. The interface device 120 is fully configurable interms of visual and operational functionalities, providing for aflexible, efficient, and user-friendly tool. In addition, the manner inwhich configuration proceeds is also flexible, such as through real timeconfiguration in a plurality of operating states. Examples of such aninterface device include a human-machine interface (HMI), man-machineinterface (MMI), graphical user interface (GUI), user interface (UI),and an operator interface (OI). The interface device 120 (along with theoperator 150) can be located in a close physical proximity to themachine or can be located at a considerable distance from the machine,allowing the operator to completely and effectively interact with themachine as if he was working directly on the equipment. The interfacedevice 120 houses at least one device element 130 that defines featuresrelating to the interface device 120 or the machine 110. For example,device elements can define properties (e.g., adjustable attributes, suchas the image representation of an element on a screen), methods (e.g.,executable functions that define the operation performed by theelement), connections (e.g., links that enable data to be exchangedamong separated elements), and communications interfaces (e.g., thesetup that enables communications to occur) of an interface device andcan include software pushbuttons, timers, gauges, PLC communicationservers, screens, and applications for their corresponding machines. Aparticular example of a device element 130 is a temperature gauge thatrecords temperature of the machine 110.

The operator 150 can be a person, group of individuals, entity, program,or artificial intelligence unit that is mainly responsible for at leastinitial setup and direction of the machine 110, along with regularlymonitoring the machine 110. The operator 150 employs the configurationstation 140 as a tool to access device elements 130 in the interfacedevice 120. When the operator 150 desires to measure, observe, test,extract, or alter something on the machine 110 or interface device 120,the operator 150 can generate a query by way of the configurationstation 140. The configuration station 140 can proceed in various ways.

A configuration station may control one or more interface devices atonce. The configuration station 140 can be integrated with the interfacedevice or it can function as stand-alone tool. In one example, anoperator can use a configuration station to develop appearance andorganization of the interface device. In another example, the operatorcan use a configuration station to set up a continuous monitoring toolto detect high levels of contamination exposed to the machine in acleansing phase of the production process. With respect toreconfiguration procedure, the configuration station 140 can upload thenecessary device element(s) 130 from the interface device 120 to theconfiguration station 140, reconfigure the device element 130 in theconfiguration station 140, and download the reconfigured device element130 back to the interface device 120. As an alternative, theconfiguration station 140 may reconfigure the device element 130directly in the interface device 120 (where uploading the device element130 to the configuration station 140 is unnecessary). This techniqueeliminates the need for a special program to retrieve and store thecode, since the changes are made directly in the environment of theinterface device. Furthermore, additional external code is not requiredto accomplish the necessary editing operations.

For this type of reconfiguration, the interface device 120 can switchbetween a development environment (to support a configuration mode) andan operational environment (to support an execution mode). While theinterface device 120 is operating in a development environment, aparallel visual representation (e.g., in the form of a JPEG file, or anysuitable static or sub-static representation) of the device elements canremain on the interface device (and refreshed when appropriate) asviewed by a user to minimize impact of obvious interruptions inoperation. To accomplish this view, relevant elements are queried toextract respective image(s) or equivalent visual representation(s) andstored in a virtual frame buffer or memory display context. This contentcan be displayed on a general purpose viewer or browser while theinterface device 120 is being configured in a development environment.

However, the configuration station 140 may reconfigure the deviceelement 130 in the interface device 120 while the interface device 120remains in execution mode so as to not interrupt operation of themachine 110. As certain device elements are actively running a process,other device elements may be edited. When configuration of those deviceelements is complete, they may be activated as soon as they becomeavailable or upon predetermined times (e.g., according to a refreshrate)—effectively achieving seamless operation of a continuous process.In an example, during a semiconductor heating process, an engineer maydecide to increase the frequency in which the temperature reading istransmitted. Since it is inefficient to stop production of the batch inorder to change that setting, the interface device supportsreconfiguration during execution. As a result, the temperature is readmore often, starting at the next wafer, once the setting is finalized,thus avoiding interruption of the process. Regardless of whichenvironment is used for reconfiguration, such reconfiguration of deviceelements is not dependent on their prior configuration. Theconfiguration station 140 does not utilize or require any priorknowledge of the nature, function, and properties of the deviceelements. Thus, specialized customization of the reconfiguration tool isnot necessary.

Depending on the ability and resources of the interface device 120, theparticular situation, and the needs of the operator 150, theconfiguration station 140 may select the most appropriate approach for aparticular query. For instance, where a complete and thoroughreconfiguration of multiple device elements is required, it may be moreeffective for the interface device 120 to switch to a developmentenvironment while the configuration station 140 is implementing thereconfiguration process. In another situation, where a simplereconfiguration that only affects one device element is required, if maybe more efficient for the configuration station 140 to directly accessthat device element while the rest of the interface device 120 continuesuninterrupted execution of its regular procedure.

In appropriate situations, the configuration station 140 may not berequired. The operator 150 can create a query that self-generatesreoccurring processes. In that case, the interface device 120essentially creates its own commands, tests, and adjustments withoutneed for constant monitoring or individualized queries.

In addition, the interface device 120 can access an external deviceelement store 160 for device elements with additional features not foundon the interface device 120. The device element store 160 can beavailable to a select group of interface devices or it can have openavailability. The device element store 160 enables different machines toefficiently have access to a wide range of device elements. Ifnecessary, the interface device 120 can optionally reach more than onedevice element store.

The interface device 120 relays and implements the correspondingcontrols, as specified by the operator 150, to the machine 110. Theinformation communicated between the interface device 120 and machine110 may be related to functions that monitor (e.g., a command to recordthe temperature of a particular chamber of the machine 110 at a certaintime) or alter (e.g., a command to rotate a robotic arm of the machine110 to a different chamber) the machine 110. The setup can be a singleor repetitive function, dependent on various constraints. One example ofa single function is a process for the purpose of testing ortroubleshooting an aspect of the machine 110. An example of a repetitivefunction is a process that measures temperature of a chamber of themachine 110 at one-hour intervals (e.g., a time-based constraint), orturns off the heating mechanism once the temperature reaches apredetermined point (e.g., an event-based constraint).

It is to be appreciated that embodiments described herein can employvarious artificial intelligence-based schemes for carrying out variousaspects thereof. For example, control of a configuration station caninvolve using an automatic classifier system and process. Theclassifiers can be employed to determine and/or infer a need forchanging settings of the interface device, as well as assisting withwhen and how to implement those changes. The classifiers can also applya utility-based analysis that considers the cost associated withimplementing the wrong setting against the cost of time and resourcesfor manual operation. Moreover, current user state (e.g., amount of freetime, urgency, need for accuracy, user frustration, display devicecapabilities . . . ) can be considered in connection with recognition inaccordance with the embodiments described herein.

A classifier is a function that maps an input attribute vector, X=(x1,x2, x3, x4, . . . xn), to a confidence that the input belongs to aclass, that is, f(X)=confidence(class). Such classification can employ aprobabilistic and/or statistical-based analysis (for example, factoringinto the analysis utilities and costs) to prognose or infer an actionthat a user desires to be automatically performed (e.g., implement achange to the interface device through the configuration station).

A support vector machine (SVM) is an example of a classifier that can beemployed. The SVM operates by finding a hypersurface in the space ofpossible inputs, which hypersurface attempts to split the triggeringcriteria from the non-triggering events. Intuitively, this makes theclassification correct for testing data that is near, but not identicalto, training data. Other directed and undirected model classificationapproaches include, e.g., naïve Bayes, Bayesian networks, decisiontrees, and probabilistic classification models providing differentpatterns of independence can be employed. Classification as used hereinalso is inclusive of statistical regression that is utilized to developmodels of priority.

As will be readily appreciated from the subject specification, thesubject invention can employ classifiers that are explicitly trained(such as by generic training data) as well as implicitly trained (suchas by observing user behavior and/or receiving extrinsic information).For example, SVM's are configured by a learning or training phase withina classifier constructor and feature selection module. Thus, theclassifier(s) can be used to automatically perform a number of functionsas described herein. Accordingly, the operator 150 can optionally employclassifiers in connection with effecting the functionalities associatedtherewith.

Referring to FIG. 2, a block diagram of a configuration station 140 thatfacilitates flexible interaction between an operator and an interfacedevice is illustrated. Not only can the configuration station 140respond to direct instructions from an operator, the configurationstation 140 may dynamically alter settings based on preferences, pastbehavior, and capabilities of the device and surrounding environment.For example, the configuration station may automatically optimizebrightness and contrast of a screen view based on the current level oflight. In another example, the configuration station may alter theamount of information displayed on a screen view based on thelimitations of the displaying device (e.g., by reducing the amount ofinformation displayed for a small screen or limited memory device). Theconfiguration station 140 comprises a connection component 220 thatestablishes a working connection between the configuration station andthe interface device, a configuration component 230 that facilitates theconfiguration of the interface device, and an operation component 240that implements such configuration on the interface device. Theconfiguration station 140 may supply direct access between an operatorand an interface device through a cable or other physical connection. Inaddition, the configuration station 140 may also be housed in a browser210 to provide remote access to one or more operators and one or moreinterface devices through an Internet or intranet connection.

The operator initiates configuration by sending a query to theconfiguration station 140. This signals the connection component 220 toestablish a connection between the configuration station 140 and theinterface device (as well as corresponding device elements residing onthe interface device and device elements linked to the interfacedevice). Upon verification that such connection has been established,the configuration component 230 selects the appropriate device elementsto develop an interface screen for the interface device. Theconfiguration component 230 may need to modify some device elements forthem to be properly implemented. A resulting user-friendly interfacescreen accommodates the operator. The operation component 240 implementsthe interface screen onto the interface device. The interface screen maybe displayed on the interface device itself, or on an application linkedto the interface device. The interface screen displays functions andoptions that are altered by the operator via the device elements.

In addition, the interface screen can be customized as a templatestructure. Such template can be saved and sent to other interfacedevices, as well as automatically generated according to specific roles,profiles, and historical data. In one instance, a set of identicalmachines may operate on a production floor. Each machine may have itsown interface screen that could be individually customized. However,having identical or consistent interface screens for all the machinesgreatly enhances the comfort of the operator because the operator wouldnot need to readjust his thought process each time he works on aparticular machine to familiarize himself with a different screen. Whenthe operator determines one interface screen template, that template canbe saved and implemented onto other interface devices without repeatingthe customization process. An interface device can switch among multiplesaved interface screens, and thus is adaptable for a variety of users.Furthermore, generation of templates can occur with explicit or implicittraining, using various classifiers. Through explicit training, a usersets forth the particular configuration scheme with detailed commands.Through implicit training, the system monitors and evaluates behavior ofthe operator, interface device, and machine, and intelligentlyimplements changes for more convenient and efficient operation.

It is to be appreciated that various aspects described herein can beautomated (e.g., through employment of artificial intelligence).Accordingly, automated action can be performed in connection withimplementing one or more functionalities. The action can be triggeredfor example based on user and/or computing state, environment,preferences, tasks at hand, goals, historical information, and otherextrinsic information. Moreover, a utility-based analysis can beemployed in connection with such automated action where for example thecost of taking an incorrect or undesired automated action is factoredagainst the benefit of taking a correct or desired automated action. Inconnection with the discussion supra related to training classifiers,such classifiers can be implicitly and/or explicitly trained inconnection with taking automated action.

The configuration station 140 can be housed within a browser 210.Through a browser 210, the configuration station 140 can be functionallyconnected to, but physically apart from, the interface device. Forinstance, when a technician has an urgent problem, he may contact anengineer. Instead of troubleshooting the problem on the productionfloor, the engineer may access the configuration station 140 through anintranet connection from his cubicle office. Moreover, the engineer canalso access the configuration station 140 from his home computer, usingthe Internet.

In view of FIG. 3, a block diagram of an interface device unloadingsystem 300 that conserves memory and optimizes overall efficiency isdepicted. As indicated in this example, the main interface screen 310incorporates device element X 320 and device element Y 330 (e.g., alldevice elements that support the interface device), while the unloadedinterface screen 340 incorporates just device element X 350 (e.g.,eliminating device element Y 330 that was not required for continuousoperation of the interface device).

The main interface screen 310 maintains a global container of allinitial device elements, while the unloaded interface screen maintainsonly the aspects necessary for the present view. Display properties(e.g., color, location, size, and text) can represent one aspect of avisual representation. Functional properties (e.g., count, interval,time, and reset) can represent another aspect of a visualrepresentation. For example, this situation applies when a graphicalview of a clock remains at 1:00 PM for 59 seconds until it turns into1:01 PM. Although the functional features of the clock must be retainedin order to keep track of the time, the visual features of the clock areconstant for these 59 seconds. Therefore, the visual features of theclock do not need to be implemented again during the time period and canbe temporarily unloaded from memory.

In one example, the main interface screen 310 comprises all deviceelements, which in this case are device element X 320 and device elementY 330. The main interface screen 310 is a display of a graphical clockthat represents the current time, e.g., 1:00 PM. Device element X 320incorporates the functional aspect of keeping track of the time, whiledevice element Y 330 incorporates the visual aspect of graphicallypresenting the time. The unloaded interface screen 340 represents asubsequent view of the interface device, e.g., a few seconds after 1:00PM. Since the visual aspect that displays 1:00 PM remains the same until1:01 PM, device element Y 330 is unloaded from memory, but deviceelement X 350 must be maintained to keep track of the progressing time.While an unloaded device element is temporarily removed from memory,that device element still remains instantiated and active.

In another example, device element Y 330 is not fully unloaded frommemory, but partially suppressed. In this situation, device element Y330 is only partially maintained as necessary in the unloaded interfacescreen 340.

By fully or partially unloading unessential device elements from activememory, overall system performance improves. Memory conservation allowsuse of available memory space to be efficient, which in turn reducesprocessing time. Remaining memory can be allocated towards other tasksthat may all run concurrently. In addition to memory conservation,transmission of redundant data wastes network resources and may impedenetwork traffic flow. Such benefits with respect to memory and networktraffic conservation apply to device element mirroring as well.

FIG. 4 illustrates a block diagram of a device element mirroring system400, another approach to memory conservation and optimization. As anexample, the device element mirroring system 400 comprises arepresentative device element X 410 with properties (X1-X4) that aremirrored by device element Y 420 (Y1-Y4). The properties of deviceelement X 410 correspond with the properties of device element Y 420(e.g., X1 and Y1 represent a color attribute, X2 and Y2 represent alocation attribute, X3 and Y3 represent a size attribute, and X4 and Y4represent a text attribute).

Device element X 410 and device element Y 420 may each act individuallyupon shared data. If device element X 410 and device element Y 420 haveidentical or related attributes, device element mirroring may be used toconserve memory and improve performance without sharing properties.Device element mirroring enables more flexible operation than propertysharing. While property sharing requires multiple device elements topoint to a single shared attribute, device element mirroring efficientlyand selectively transmits necessary data from one device element to oneor more other device elements. The transfer of signals between deviceelements can be based on events that are manual or automatic in nature.A manual event is one that is directed by forced input from a user(e.g., a command entered by the click of a mouse). An automatic event isone that is based on circumstances unique to a situation (e.g., adetection of a dangerous condition that automatically triggers a warningmessage).

For example, device element X 410 comprises four properties, X1, X2, X3,and X4, which represent the color, location, size, and text,respectively. Device element Y 420 comprises its own four properties,Y1, Y2, Y3, and Y4, which correspond to the same category types as thosefound in device element X 410. Device element X 410 receives data from asource. This data communicates a warning message, which triggers achange in X1, the color property, of device element X 410 from green tored. The property change of X1 in device element X 410 triggers deviceelement mirroring in device element Y 420 to change its color property,Y1, from green to red as well.

Device element mirroring of device element Y 420 from device element X410 does not necessarily require that device element Y 420 mirror anidentical or analogous property of device element X 410. For instance,color property X1's change from green to red can trigger text propertyY4's change from “GO” to “STOP”—in addition to (or instead of) the Y1color property change described above.

In another example, the data communicated from the source to deviceelement X 410 can trigger device element mirroring. Rather than wait fora property change in device element X 410, device element Y 420 mayinitiate the mirroring function upon indication that device element X410 has received the appropriate data from the source. For example,color property Y1 can be set to always match color property X1,regardless of what color it is or what type of data was triggered at thesource.

As depicted in FIG. 5, a block diagram of an emulation system 500 forsoftware mimicking of a hardware implementation is represented. Theemulation system 500 comprises a hardware interface device 510,containing full-scale applications 520, device elements 530, and screenviews 540, and a software emulator 550, containing the correspondingsoftware instances of the applications 560, device elements 570, andscreen views 580. Multiple emulators can be created for a singlehardware device, and a single emulator can contain elements extractedfrom more than one hardware device.

The interface device 510 is a hardware representation of the tool usedby an operator to interact with a machine. The interface device 510 isconfigured with applications 520, device elements 530, and screen views540 for a user-friendly presentation to the operator. The emulator 550is a software implementation of the interface device 510. The emulator550 provides a simple and inexpensive platform to develop, test, andfinalize the configuration of an interface device 510 before suchimplementation occurs on an actual piece of hardware.

The emulator 550 is created by extracting copies of the applications520, device elements 530, and screen views 540 of the interface device510. The resulting product is a software version of the hardware device,with fully functional and configurable features. The applications 560,device elements 570, and screen views 580 on the emulator 550 willbehave identically to the applications 520, device elements 530, andscreen views 540 on the actual interface device 510. For instance, adeveloper may want to test a heating function that heats a chamber ofthe machine after an item counter reaches a certain count. The developermay want to reconfigure this feature by adding supplementary functions,such as a rotation task at certain intervals of time. While testprocedures in hardware can be expensive and dangerous, troubleshootingproblems in the software can be debugged simply by altering the code.The process can be continuously adjusted on the emulator 550 until thefull reconfiguration is finalized.

Upon satisfactory completion of the reconfiguration process of theemulator 550, the newly developed features are ready to be transferredto the hardware interface device 510. The applications 560, deviceelements 570, and screen views 580 on the emulator 550, as modified, areloaded onto the interface device 510 to replace the originallyconfigured applications 520, device elements 530, and screen views 540.The behavior of the interface device 510 has already been mimicked andpredicted by the emulator 550, therefore minimizing the moretime-consuming hardware implementation and adjustment by a developer.

In view of the exemplary systems illustrated and described above,methodologies that may be implemented in accordance with the embodimentswill be better appreciated with reference to the flow charts of FIGS.6-11. While, for purposes of simplicity of explanation, themethodologies are depicted and described as a series of blocks, it is tobe understood and appreciated that the embodiments are not limited bythe order of the blocks, as some blocks may, in accordance with anembodiment, occur in different orders and/or concurrently with otherblocks from that shown and described herein. Moreover, not allillustrated blocks may be required to implement the methodologies inaccordance with the embodiments.

The embodiments may be described in the general context ofcomputer-executable instructions, such as program modules, executed byone or more components. Generally, program modules include routines,programs, objects, data structures, etc., that perform particular tasksor implement particular abstract data types. Typically, thefunctionality of the program modules may be combined or distributed asdesired in various instances of the embodiments.

FIG. 6 illustrates a flow diagram of a method 600 of facilitatingindustrial control, e.g., configuration or reconfiguration of aninterface device. In particular, the method 600 outlines a generalprocess for interface device configuration through instructions from anoperator. The method 600 starts by verifying the connection between theconfiguration station and the interface at 610. Such connection can be adirect connection, an intranet connection, or an Internet connection andcan be indicated on the configuration station. Without initialverification of a connection, efforts to transmit and receive data arefutile.

Once the connection has been established, at 620, the operatorconfigures the interface device using the configuration station.Configuration of the interface device through its device elements can beperformed in a development environment or an operational environment. Tosupport configuration within a development environment, the interfacedevice temporarily pauses the execution of all running processes andallows an operator to freely modify, delete, or add device elements. Tosupport configuration within an operational environment, the interfacedevice's execution process is not interrupted while the operatorconfigures device elements that are not active at the moment. In eitherenvironment, configuration is accomplished without using a specialprogram to retrieve and harbor the code using external resources.

If configuration of the interface device is desired in a developmentenvironment, display views can be maintained to provide a continuousvisual representation of the interface device. In preparation for thisview, each device element is first queried to extract its image orequivalent visual representation. Then, these images are collected andstored in a virtual frame buffer or memory display context. Therefore,this content is displayed on a general purpose viewer or browser whilethe interface device switches from an operational environment to adevelopment environment for device element configuration.

After the interface device is fully configured, operation of the newlyconfigured interface device resumes at 630. If the interface deviceswitched to a configuration mode at 620, the interface device would thenswitch back to the execution mode after the reconfiguration wascomplete. If the interface device did not switch to a configuration modeand instead remained in execution mode at 620, transition fromconfiguration to operation of the interface device appears to occuralmost uninterrupted.

FIG. 7 is another flow diagram of a method 700 of facilitatingindustrial control, affording various options in which device elementsof an interface device are managed and configured. The method 700 beginsby detecting an interface device through a configuration station at 705.The detection can be triggered upon an event or regular or sporadicoccurrences. At 710, if the device is recognized as valid andconfigurable, the method 700 proceeds to determine at 715 whether apassword is required for access to the interface device. If a passwordis required, at 720 the password entered in response to a prompt isverified for accuracy. At 725, if the password is correct, the method700 continues to 735, where the interface device receives and processesconfiguration information from the configuration station. If a passwordis not required at 715, the method 700 immediately proceeds to 735 toreceive and process configuration information. In a circumstance wherethe interface device is not valid and configurable at 710, or where thesubmitted password is incorrect at 725, the configuration process doesnot occur.

The configuration of the device elements can occur in the interfacedevice or in the configuration station. At 740, the operator determineswhether he would like to download the device elements to theconfiguration station. If so, the device elements are downloaded fromthe interface device at 745, configured in the configuration station at750, and uploaded back to the interface device at 755. At 740, if theoperator determines he would not like to download the device elements tothe configuration station, at 760, configuration of the device elementsoccur directly in the interface device.

Regardless of where the configuration occurs (in the interface device orin the configuration station), the connection can be supported bynumerous ways. One option is to have a direct link between theconfiguration station and the interface device. In particular, theconfiguration station may be housed in the interface device or connectedthrough a direct line. In the alternative, the configuration station mayaccess the interface device remotely with a browser, enabling one ormore operators to view the configuration station from any computerconnected to the intranet or Internet.

FIG. 8 illustrates a flow diagram of a method 800 of facilitating anunloading module that supports memory conservation and efficiency bytemporarily removing unessential device elements from active memory. Themethod 800 starts at 810, in view of an initial interface screen thatretains all aspects (visual and operational) of the necessary deviceelements in a global memory container. For example, the first screen maypresent a digital temperature display such as 50° F. If the numeric viewis set to display only integers, it is irrelevant from the perspectiveof the display whether the actual temperature is 49.6° F. or 50.2° F.because in either situation (rounded to the nearest one), the appearanceremains at 50° F. Before proceeding to the next screen, the method 800checks for such idle elements at 820. Status checking can occur atregular or random time intervals or can be triggered based on certainevents or changes to the interface device.

If there are idle elements, at 830, the interface device temporarilyunloads those unnecessary device elements from the global memorycontainer. In the above example, the device elements representingdisplay property features (e.g., font, color, position, and text) isunloaded from memory. The remaining device elements (e.g., featuresrelating to monitoring and measurement of temperature) are retained inmemory for the next screen view at 840. In the example discussed above,if the temperature were to rise to 50.2° F., the device elementssupporting the screen view would be unloaded, but the device elementssupporting the internal monitoring, measuring, and recording of thetemperature would be retained so that the interface device contains acurrent and accurate determination of the actual temperature. Returningto 820, if all device elements are active and required for thesubsequent screen, then all device elements are retained in memory at840.

FIG. 9 refers to a flow diagram of a method 900 of facilitating deviceelement mirroring, another option for conserving memory by directlycommunicating a change between two device elements with an identical orsimilar property. One device element processes received informationrelating to a property change and at least one other device elementmirrors this change by performing the same or a related change withoutprocessing the information again.

To begin, at 910 the source sends data to a first device element. Thedata indicates an instruction with respect to a setting or changing oneor more properties. The first device element receives and processes thedata at 920, and adjusts one or more properties according to theprocessed data at 930. At 940, if the property change triggers deviceelement mirroring, then the first device element sends data indicatingthe property change to the second device element at 950. The seconddevice element receives and processes this information at 960 andautomatically adjusts an identical or related property at 970. Theadjustment can occur immediately or after a random or predeterminedperiod of time. Returning to 940, if the first device element's propertychange does not trigger device element mirroring, then the second deviceelement does not receive further information regarding the presentsituation.

In addition, device element mirroring may work as a chain, a group, or acombination of the two. As a chain, the second device element maytrigger mirroring of another device element, which may trigger mirroringof yet another device element, and so on. As a group, a property changein one device element can trigger the function of multiple deviceelements that concurrently mirror that device element. In a combinationof chain and group process, many device elements can be variouslymirrored in a web of interconnections.

Turning to FIG. 10, another flow diagram of a method 1000 offacilitating device element mirroring based on source-triggering eventsis presented. In this situation, at 1010, the source sends data to thefirst device element. The data can originate from an event based onmanual or automatic sources. For example, a user can manually submit acommand to force device element mirroring. In addition, a detectedemergency occurrence can trigger a warning message that necessitatesdevice element mirroring. This data transmission leads to the prompt at1020 to determine whether device element mirroring is triggered. If so,at 1030, the first device element receives and processes the data fromthe source. At 1040, the first device element sends data to the seconddevice element and at 1050, the second device element receives andprocesses the data from the first device element. Finally, at 1060, thefirst device element and the second device element adjust theirrespective properties at the same time. In the alternative, the firstdevice element could have adjusted its property at 1050, while thesecond device element was receiving and processing its data. Yet anotheroption is to hold the adjustment of the first device element's propertyuntil after the second device element has completed its adjustment.

Going back to 1020, if the data transmission from the source does nottrigger device element mirroring, then at 1070, only the first deviceelement receives and processes the data from the source and at 1080,adjusts its property accordingly. Since device element mirroring is nottriggered, the second device element is left alone.

As illustrated, FIG. 11 is a flow diagram of a method 1100 of creatingan emulator in order to execute the same firmware on a personal computeras is executed by an interface device. Emulation enables versatilesoftware development of an interface device without committing theconfiguration to hardware, conserving time and resources. Starting with1110, an emulator is created by extracting a software copy of theinterface device. This copy is a full duplication of the interfacedevice with fully functioning features. At 1120, a user connects to theemulator and creates a user application file on the emulator, whichbehaves exactly as it would on the actual interface device. The userapplication file is a template with user-customizable properties. Forexample, properties can be configured for functionality, accuracy, anduser-friendliness. If those properties are not satisfactory, they can beadjusted as necessary. At 1130, if a developer feels that the userapplication file requires further customization, he may return to 1120and run test programs and change the code as many times as he wishes.When the user application file is configured to the developer'ssatisfaction, he may download the user application file to the interfacedevice hardware at 1140.

In order to provide a context for the various aspects of the disclosedsubject matter, FIGS. 12 and 13 as well as the following discussion areintended to provide a brief, general description of a suitableenvironment in which the various aspects of the disclosed subject mattermay be implemented. While the subject matter has been described above inthe general context of computer-executable instructions of a computerprogram that runs on a computer and/or computers, those skilled in theart will recognize that the invention also may be implemented incombination with other program modules. Generally, program modulesinclude routines, programs, components, data structures, etc. thatperform particular tasks and/or implement particular abstract datatypes. Moreover, those skilled in the art will appreciate that theinventive methods may be practiced with other computer systemconfigurations, including single-processor or multiprocessor computersystems, mini-computing devices, mainframe computers, as well aspersonal computers, hand-held computing devices (e.g., personal digitalassistant (PDA), phone, watch . . . ), microprocessor-based orprogrammable consumer or industrial electronics, and the like. Theillustrated aspects may also be practiced in distributed computingenvironments where tasks are performed by remote processing devices thatare linked through a communications network. However, some, if not allaspects of the invention can be practiced on stand-alone computers. In adistributed computing environment, program modules may be located inboth local and remote memory storage devices.

With reference to FIG. 12, an exemplary environment 1210 forimplementing various aspects disclosed herein includes a computer 1212(e.g., desktop, laptop, server, hand held, programmable consumer orindustrial electronics . . . ). The computer 1212 includes a processingunit 1214, a system memory 1216, and a system bus 1218. The system bus1218 couples system components including, but not limited to, the systemmemory 1216 to the processing unit 1214. The processing unit 1214 can beany of various available microprocessors. Dual microprocessors and othermultiprocessor architectures also can be employed as the processing unit1214.

The system bus 1218 can be any of several types of bus structure(s)including the memory bus or memory controller, a peripheral bus orexternal bus, and/or a local bus using any variety of available busarchitectures including, but not limited to, 11-bit bus, IndustrialStandard Architecture (ISA), Micro-Channel Architecture (MSA), ExtendedISA (EISA), Intelligent Drive Electronics (IDE), VESA Local Bus (VLB),Peripheral Component Interconnect (PCI), Universal Serial Bus (USB),Advanced Graphics Port (AGP), Personal Computer Memory CardInternational Association bus (PCMCIA), and Small Computer SystemsInterface (SCSI).

The system memory 1216 includes volatile memory 1220 and nonvolatilememory 1222. The basic input/output system (BIOS), containing the basicroutines to transfer information between elements within the computer1212, such as during start-up, is stored in nonvolatile memory 1222. Byway of illustration, and not limitation, nonvolatile memory 1222 caninclude read only memory (ROM), programmable ROM (PROM), electricallyprogrammable ROM (EPROM), electrically erasable ROM (EEPROM), or flashmemory. Volatile memory 1220 includes random access memory (RAM), whichacts as external cache memory. By way of illustration and notlimitation, RAM is available in many forms such as synchronous RAM(SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rateSDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), anddirect Rambus RAM (DRRAM).

Computer 1212 also includes removable/non-removable,volatile/non-volatile computer storage media. FIG. 12 illustrates, forexample, disk storage 1224. Disk storage 1224 includes, but is notlimited to, devices like a magnetic disk drive, floppy disk drive, tapedrive, Jaz drive, Zip drive, LS-100 drive, flash memory card, or memorystick. In addition, disk storage 1224 can include storage mediaseparately or in combination with other storage media including, but notlimited to, an optical disk drive such as a compact disk ROM device(CD-ROM), CD recordable drive (CD-R Drive), CD rewritable drive (CD-RWDrive) or a digital versatile disk ROM drive (DVD-ROM). To facilitateconnection of the disk storage devices 1224 to the system bus 1218, aremovable or non-removable interface is typically used such as interface1226.

It is to be appreciated that FIG. 12 describes software that acts as anintermediary between users and the basic computer resources described insuitable operating environment 1210. Such software includes an operatingsystem 1228. Operating system 1228, which can be stored on disk storage1224, acts to control and allocate resources of the computer system1212. System applications 1230 take advantage of the management ofresources by operating system 1228 through program modules 1232 andprogram data 1234 stored either in system memory 1216 or on disk storage1224. It is to be appreciated that the present invention can beimplemented with various operating systems or combinations of operatingsystems.

A user enters commands or information into the computer 1212 throughinput device(s) 1236. Input devices 1236 include, but are not limitedto, a pointing device such as a mouse, trackball, stylus, touch pad,keyboard, microphone, joystick, game pad, satellite dish, scanner, TVtuner card, digital camera, digital video camera, web camera, and thelike. These and other input devices connect to the processing unit 1214through the system bus 1218 via interface port(s) 1238. Interfaceport(s) 1238 include, for example, a serial port, a parallel port, agame port, and a universal serial bus (USB). Output device(s) 1240 usesome of the same type of ports as input device(s) 1236. Thus, forexample, a USB port may be used to provide input to computer 1212 and tooutput information from computer 1212 to an output device 1240. Outputadapter 1242 is provided to illustrate that there are some outputdevices 1240 like displays (e.g., flat panel and CRT), speakers, andprinters, among other output devices 1240 that require special adapters.The output adapters 1242 include, by way of illustration and notlimitation, video and sound cards that provide a means of connectionbetween the output device 1240 and the system bus 1218. It should benoted that other devices and/or systems of devices provide both inputand output capabilities such as remote computer(s) 1244.

Computer 1212 can operate in a networked environment using logicalconnections to one or more remote computers, such as remote computer(s)1244. The remote computer(s) 1244 can be a personal computer, a server,a router, a network PC, a workstation, a microprocessor based appliance,a peer device or other common network node and the like, and typicallyincludes many or all of the elements described relative to computer1212. For purposes of brevity, only a memory storage device 1246 isillustrated with remote computer(s) 1244. Remote computer(s) 1244 islogically connected to computer 1212 through a network interface 1248and then physically connected via communication connection(s) 1250.Network interface 1248 encompasses communication networks such aslocal-area networks (LAN) and wide-area networks (WAN). LAN technologiesinclude Fiber Distributed Data Interface (FDDI), Copper Distributed DataInterface (CDDI), Ethernet/IEEE 802.3, Token Ring/IEEE 802.5 and thelike. WAN technologies include, but are not limited to, point-to-pointlinks, circuit-switching networks like Integrated Services DigitalNetworks (ISDN) and variations thereon, packet switching networks, andDigital Subscriber Lines (DSL).

Communication connection(s) 1250 refers to the hardware/softwareemployed to connect the network interface 1248 to the bus 1218. Whilecommunication connection 1250 is shown for illustrative clarity insidecomputer 1212, it can also be external to computer 1212. Thehardware/software necessary for connection to the network interface 1248includes, for exemplary purposes only, internal and externaltechnologies such as, modems including regular telephone grade modems,cable modems, power modems and DSL modems, ISDN adapters, and Ethernetcards or components.

FIG. 13 is a schematic block diagram of a sample-computing environment1300 with which the present invention can interact. The system 1300includes one or more client(s) 1310. The client(s) 1310 can be hardwareand/or software (e.g., threads, processes, computing devices). Thesystem 1300 also includes one or more server(s) 1330. Thus, system 1300can correspond to a two-tier client server model or a multi-tier model(e.g., client, middle tier server, data server), amongst other models.The server(s) 1330 can also be hardware and/or software (e.g., threads,processes, computing devices). The servers 1330 can house threads toperform transformations by employing the present invention, for example.One possible communication between a client 1310 and a server 1330 maybe in the form of a data packet adapted to be transmitted between two ormore computer processes. The system 1300 includes a communicationframework 1350 that can be employed to facilitate communications betweenthe client(s) 1310 and the server(s) 1330. The client(s) 1310 areoperatively connected to one or more client data store(s) 1360 that canbe employed to store information local to the client(s) 1310. Similarly,the server(s) 1330 are operatively connected to one or more server datastore(s) 1340 that can be employed to store information local to theservers 1330.

It is to be appreciated that the systems and/or methods of theembodiments can be facilitated with computer components and non-computerrelated components alike. Further, those skilled in the art willrecognize that the systems and/or methods of the embodiments areemployable in a vast array of electronic related technologies,including, but not limited to, computers, servers, and/or handheldelectronic devices, and the like.

What has been described above includes examples of the embodiments. Itis, of course, not possible to describe every conceivable combination ofcomponents or methodologies for purposes of describing the embodiments,but one of ordinary skill in the art may recognize that many furthercombinations and permutations of the embodiments are possible.Accordingly, the subject matter is intended to embrace all suchalterations, modifications, and variations that fall within the spiritand scope of the appended claims. Furthermore, to the extent that theterm “includes” is used in either the detailed description or theclaims, such term is intended to be inclusive in a manner similar to theterm “comprising” as “comprising” is interpreted when employed as atransitional word in a claim.

1. An industrial automation system, comprising: an interface device,comprising a first device element that represents a visual aspect of theinterface device, a second device element that represents an operationalaspect of the interface device and a global memory container that housesthe first device element and the second device element, wherein theinterface device determines whether at least one of the first deviceelement or the second device element is an idle device element andtemporarily unloads the idle device element from the global memorycontainer; and a configuration station that configures the idle deviceelement, wherein the interface device operates in an execution mode whenthe configuration station configures the idle device element.
 2. Thesystem of claim 1, the interface device is at least one of a humanmachine interface (HMI), a graphical user interface (GUI), a userinterface (UI), an operator interface (OI) or a man-machine interface(MMI).
 3. The system of claim 1, the interface device further comprisesa main interface screen that incorporates the first device element andthe second device element.
 4. The system of claim 1, the interfacedevice further comprises an unloaded interface screen that eliminatesthe idle device element.
 5. The system of claim 1, the interface devicedetermines whether the at least one of the first device element or thesecond device element is the idle device element according to a refreshrate.
 6. The system of claim 1, the configuration station receives aninstruction from an operator to configure the idle device element. 7.The system of claim 1, the configuration station is directly connectedto the interface device.
 8. The system of claim 1, the configurationstation is housed in a browser and communicatively connected to theinterface device.
 9. A method for configuring an interface device in anindustrial automation system, comprising: operating an interface devicein an execution mode; checking a status of a first device element thatrepresents a visual aspect of the interface device and a second deviceelement that represents an operational aspect of the interface device;determining whether at least one of the first device element or thesecond device element is an idle device element based at least in partupon the checking; unloading the idle device element from a globalmemory container for a temporary period of time; and configuring theidle device element while operating the interface device in theexecution mode.
 10. The method of claim 9, further comprisingreinstating the idle device element after the temporary period of timelapses.
 11. The method of claim 10, further comprising checking a secondstatus of the first device element and the second device element anddetermining whether at least one of the first device element or thesecond device element is a second idle device element.
 12. The method ofclaim 11, further comprising unloading the second idle device elementfrom the global memory container for a second temporary period of time.13. The method of claim 9, the checking the status further compriseschecking at a time interval.
 14. The method of claim 9, furthercomprising receiving a request to configure the idle device element froman operator.
 15. An interface device that in an industrial automationenvironment, comprising: a first device element that represents a visualaspect of the interface device; a second device element that representsan operational element of the interface device; and a global memorycontainer that houses the first device element and the second deviceelement, wherein the interface device performs a status check anddetermines whether at least one of the first device element or thesecond device element is an idle device element and temporarily unloadsthe idle device element from the global memory container, and whereinthe interface device operates in an execution mode while the idle deviceelement is configured.
 16. The device of claim 15, wherein the interfacedevice performs the status check at regular intervals.
 17. The device ofclaim 15, further comprising a main interface screen that incorporatesthe first device element and the second device element.
 18. The deviceof claim 15, further comprising an unloaded interface screen thateliminates the idle device element.
 19. The device of claim 15, whereinthe idle device element is configured in response to an instruction froman operator.
 20. The device of claim 15, wherein the interface devicereinstates the idle device element to the global memory container aftera period of time.